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Abstract 



All ground states and low-lying excitations of a ± I Ising spin glass 
model on a cubic 4x4x4 lattice with periodical boundary conditions 
were calculated using a method of combinatorical optimization. The 
structure of states in the phase space is enlightened by a representation 
by means of clusters in the configuration space and their connectivity. 
The relaxation behaviour of the system can be described by random 
walks in the high-dimensional phase space. Rewriting this task as an 
eigenvalue problem the influence of 'cntropic barriers' in comparison 
with an unstructured system can be studied, leading to a better un- 
derstanding of the anomalous slow dynamic behaviour. 

1 Introduction 

It is well established that the complicated structure of the phase space is 
the key to understand the unusual behaviour of spin glasses. But up to now, 
there is little known about the details of this structure even in the simple 
case of an Ising spin-glass model. 

Because of the complexity of the problem and the huge number of 2^ 
configurations of the system with N spins exact complete enumerations re- 
strict the size of the system which can be considered to N = 20 . . . 30. In 
principle, the ground state is given by the minimization task, in the zero-field 
case, 
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For analyzing the exact low-energy landscape the knowledge of postoptimal 
solutions of (1) is necessary, too. Optimization tasks of this kind are also 
important in other fields of physical, mathematical and biological sciences, 
see e.g. the Coulomb glass problem ||], the Travelling Salesman problem 
H and the protein folding problem Q . 

The first numerical method based on nonlinear combinatorical opti- 
mization used a branch-and-bound algorithm ||. It was applied to find 
the ground state of a two-dimensional amorphous Ising system with N = 
40 ... 60 antiferromagnetically interacting spins ( || - ) . For a ± / spin 
glass on a square L x L lattice the ground state can be found with polyno- 
mial in N increasing computing time (|| - [11]). The first exact analysis of 
the morphology of ground states of a spin system with periodical boundary 
conditions was given by Barahona et al. [10] for L = 20 using the minimal 
matching of frustrated plaquettes 12]. Systems with equally distributed 



+ / and - I interactions are characterized by a considerable ground-state 
degeneration, but there are spins, which maintain the same orientation in 
all ground states and thus form connected patches, the so-called 'packets of 
solidary spins' [10]. Such a 'packet' can be flipped as a whole without any 
cost in energy. An exact method to compute the complete partition function 
for L up to 36 is described in [13]. 

For ± / systems with increasing concentration of antiferromagnetic bonds 
p the ground-state threshold is determined as the critical concentration p c 
for the vanishing of the ferromagnetic ground state. This concentration can 
be calculated by heuristic algorithms (see e.g. [14, |lj|]) or by exact minimal 
matchings up to a size of L = 300 p6|. 



Two-dimensional problems with external field [17] and three-dimensional 
ones [18] belong to the class of NP-hard problems [IS]. This makes it unlikely 
that an algorithm can be found which is as efficient as in the zero-field two- 
dimensional case. A cubic ± / system with L = 4 and periodical boundary 
conditions is considered in pO] using a recursive branch-and-bound algo- 



rithm [21]. All ground states and all low- lying excited states are charac- 
terized in respect to their connections in the configuration space. Ground- 
state calculations for an analogous system but using periodical boundary 
conditions in two dimensions and free boundaries in the third are recently 
given on the basis of the transfer-matrix method [22]. It should be men- 
tioned that exact ground-state calculations are complementary to Monte 
Carlo (MC) calculations (cp. |^] for the three- dimensional ± / spin glass 
up to L = 64). A useful combination of MC methods and exact numerical 
investigations enables an analysis of the low-energy structures at least in 
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local regions of the phase space, see e.g. [24]. 

Spin glasses appear as suitable model systems to discuss relaxation and 
aging processes in glassy systems. On a purely phenomenological level the 
anomalously slow dynamical behaviour is described in terms of empirical 
laws. Mostly the Kohlrausch law [25] is used to characterize the time de- 
pendence of physical quantities by stretched exponentials. Various attempts 
have been made to give a physical understanding of this picture. The heuris- 
tic basis is attributed to the morphology of the phase space, assuming that it 
is partitioned in 'components' by bifurcation-like splitting [26], which at first 
was mentioned as an idea by Krey p^ ]. A complex spanning phase-space 
structure is suggested by the method of damage spreading [|^] analogous to 
a percolating cluster in a high-dimensional hypercube p9j ]. Theoretical con- 
cepts on the basis of the infinite-range Sherrington-Kirkpatrick (SK) model 
[j30f support a special hierarchical topology of the phase space characterized 
by an ultrametric organization of metastable states which are separated by 
energy barriers |j3l||. This picture seems to be consistent with exact re- 



sults for systems with up to N = 24 spins [32], heuristic estimations (up to 
N = 96) and experiments |34|, j35j| . However, there are also arguments 
against hierarchically constrained dynamics at least for certain time scales 

In mesoscopic models special plausible assumptions on the phase-space 
structure are made. Random walks on tree structures [37] belong to this 
class of theoretical concepts. Another picture is the droplet model ( |38[] - 
]p0| ), which seems to be related with the above mentioned 'packet of solidary 
spins' in the ± / spin glass [jlO[j . Starting with the assumption of only one 
ground state (apart from the mirror symmetry of the problem) a droplet 
of the length scale I is that multi-spin cluster of coherently flipped spins 
which contains a certain spin and belongs to the lowest excitation energy 
due to flipping pGj] . Such droplets were also found earlier in two-dimensional 
amorphous Ising systems with antiferromagnetic interactions (N = 40 . . . 60) 

^, O]. Experiments on relaxation of the magnetization of spin glasses 
qualitatively agree with the results found on the basis of the droplet concept 
of low-lying excitations which dominate the long-distance and long-time 
correlations fi2|| . Further theoretical investigations e.g. on aging in spin 
glasses support the droplet scenario, too. The question, whether or 
not the droplet model for short-range spin glasses is in contradiction with 
hierarchical concepts for the infinite-range SK model, is actively discussed 
[j35| , f44| . Especially, the validity of the droplet theory in more than two 
dimensions is not yet clear |45], 46]. 
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It is expected that a number of still open questions can be handled by 
means of microscopic concepts. First investigations which make use of the 
exact knowledge of the low-energy landscape in the phase space of complex 
systems let this approach appear to be promising. In || all configurations 
connected to a certain suboptimal solution of a Travelling Salesman problem 
(N = 32) are considered. They form a 'phase space pocket' around this 
minimum. This method has been extended to two-dimensional (L = 8) and 
three- dimensional (L = 4) short-range Gaussian Ising spin glass systems 

The purpose of the present work is to extend the idea of microscopic 
considerations using for the first time the exact knowledge of the global 
low-energy phase-space structure of a three-dimensional ± / spin glass (sec- 
tion 2). The the long-time behaviour of random walks on this structure 
represented by the largest nontrivial eigenvalue of the transition matrix in 
the case of infinite temperature is calculated and compared with that of an 
unstructured system (section 3). 



2 Model 

A cubic Ising spin glass system on a 4 x 4 x 4 lattice with ± / interactions 
between nearest neighbours and periodical boundary conditions in all three 
directions is considered. The distribution of interactions is randomly chosen 
with an exact portion of 50% of ferromagnetic and of antiferromagnetic 
bonds. For this system (1) was solved by the method of recursive branch- 
and-bound Additional, all energetically low-lying states were calculated 
with this method. 

In |2n] the mean ground-state energy per spin E (T — > 0) /N = 1.733 (±0.013) / 
and the mean ground-state entropy per spin S (T — > 0) /N = 0.073 (±0.007) fee 
(ks - Boltzmann constant) were found by calculating the ground-state prop- 
erties of 200 systems with different distributions of the interactions (Fig. 1). 

A classification of the found states of the representative system in Fig. 1 
by means of their neighbouring relations in the configuration space leads to 
an exact first schematic picture of the 'valley structure' in the configuration 



space [20]. This was done by arranging all the states with an energy lower 
than a chosen energy in clusters. By definition, two spin configurations 
belong to the same cluster whenever a chain connecting them exists building 
on neighbouring members of this cluster. Neighbours in the configuration 
space may differ only in the orientation of a single spin. There are no paths 
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between different clusters. 

At first glance the schematic picture in p(J could be explained by a hi- 
erarchical organization of the clusters p7| , [48| as shown in Fig. 2a. But 
another more detailed investigation of the structure with respect to 'micro- 
canonical' clusters (i.e. all members of a cluster have the same energy) leads 
to a more complex picture (Fig. 2b). The found closed circle paths can- 
not be described by a hierarchy. Moreover, there are connections between 
different clusters which do not go across energy barriers but underrun such 
barriers by going first to intermediate states with lower energy. 

It should be mentioned here that the connections drawn in Fig. 2b only 
show that at least one path between the concerned clusters exists, but there 
is no information about the total number of paths and how difficult it is to 
find them. 



3 Random Walk 



One method to quantify the connectivity of the phase space is the concept 
of the random walk. A random walk on the subset of M low-lying states can 



be written in matrix notation and solved as an eigenvalue problem [49 
This will be outlined briefly below. 

Let p(t) be the vector of probabilities, whose elements Pi(t) give the 
probability, that at time t the system is in the state i. One time step in the 
random walk will then be described by 



p(i+l) = Ap(i) 
where A is the transition matrix with 



(2) 



A 



M 

W ki 



for i ^ j 



for i 



(3) 



The element Wij denotes the transition probability per unit time from state 
j to state i and is given by 





w 



i.i 



N 



^exp{-f3(E l -E J )} 



if states i and j are not nearest neighbours 
(i.e. Hamming distance > 1) 

if states i and j are nearest neighbours and Ei < Ej 
if states i and j are nearest neighbours and E{ > Ej 

(4) 
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where (3 = 1/ksT, Ei denotes the energy of state i and N is the maximal 
number of nearest neighbours, i.e. the number of spins. Because of the 
definition of A the total probability in the system is constant. 

Only for (5 = is the matrix A symmetric. For (3 > the problem can 
be transformed into a symmetric one taking into consideration the detailed 



balancing in the equilibrium distribution [49]. So in the following we restrict 
ourself to the case (3 = 0. 

For calculating the time evolution of the system it is useful to split any 
starting state at time t = by the system of eigenvectors of A: 

M-l 

p(0)=^a i b i , Ab i = A i b< (* = 0...M-1). (5) 

i=0 

Because the matrix A is real and symmetric, all A, must be real and can 
be ordered by Ao > Ai > . . . > Xm-1- Furthermore all eigenvalues are 
restricted to |Aj| < 1. The largest eigenvalue Ao = 1 is the trivial one and 
describes the equilibrium state bo = p(oo) with pi(oo) oc exp(— f3Ei) . 

Rewriting (2) with respect to (5) the probability distribution at time t 
is given by 

M-l 

p(t) = Ap(t- 1) = AA... Ap(0) = A'p(O) = A* ^ afo 

8=0 

M-l 

= E A *«> b * • (6) 

i=0 

A simple measure of the spreading in the configuration space is the mean 
distance r^{t) from the starting configuration k of a random walk. If 
denotes the vector of Hamming distances to the configuration k, r^(t) can be 
written as r^t) = hjTp(i) • The deviation to the equilibrium distance 
is then 

/ M-l \ 



Qk{t) = r fc (oo) - r k (t) = hi yo - OibiXlj 
M-l M-l 

= ~ aihJbjA- = Y 7fciexp(ilnAi) ; = ajh^hj (7) 

i=l i=i 

using ao = 1. In the limit of large times one gets 

qk(t — > oo) oc exp(tlnAi) . (8) 
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Fig. 3 shows qk(t) for random walks in the representative system with 
different starting configurations k and (3 = 0. The considered subset con- 
sists of all states with an energy lower or equal to the second excitation. As 
expected for long times all curves show an exponential decay with the same 
exponent InAi = —2.98 • 10 -6 , which does not depend on the starting posi- 
tion. The time belonging to this value t\ = 3.36 • 10 5 is considerable larger 
than that of an unstructured system, which was calculated in a comparing 
calculation as r* = 74, see Appendix A. 



4 Conclusions 

Based on the exact knowledge of the global low-energy phase-space structure 
for a4x4x4±J Ising spin glass it is possible to obtain a schematic detailed 
picture, which shows clusters in the phase space and their connections. The 
appearence of closed circle paths and the possible underrunning of energy 
barriers are difficult to describe solely by a simple hierarchical concept. 

By the reason of this complicated structure, in general, the relaxation 
behaviour should be determined not only by the existing energy barriers 



but also by 'entropic barriers' 26]. In the case of increasing temperature 
the influence of the energetic barriers should decrease. Thus, if there is any 
entropic effect it should be found first in the limes of infinite temperature. 
However, it should be noted that there is an influence of the cut-off energy, 
which is necessary in our calculations. 

In first approximation the long-time behaviour of a random walk in the 
low-energy landscape of the system can be characterized by the largest non- 
trivial eigenvalue of the transition matrix. It could be shown that in com- 
parison with an unstructured system there is a slowing down by a factor of 
about 10 3 in the relaxation. 

The additional temperature-dependent influence of energy barriers on 
the dynamics is the subject of further investigations. 
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Appendix A - Unstructured Systems 



An unstructured system in our sense is a system with minimal structural 
information. For the reason of comparing it with our system it should have 
the same number of states M. For every state of the unstructured system 
the number of nearest neighbours d has to be equal to the mean number 
of nearest neighbours in our system. The number of spins N and thus the 
dimension of the hypercube describing the whole configuration space is equal 
for both systems. 

The construction of a fictive approximated unstructured system was done 
by dilution of a L>-dimensional hypercube where D < N. This hypercube 
is embedded in the large hypercube with dimension N. Every state of the 
subcube has to be occupied with a probability of d/D to get d nearest 
neighbours instead of D for the fully occupied subcube. Since for d > 1 this 
probability is larger than the percolation threshold of such a hypercube p9| ] 
the remaining subset should form at least one large connected cluster. 

Starting the random walk from state i because of the symmetry of the 
system the occupation probability of state j should only depend on the dis- 
tance between these two states. Therefore the states of the diluted subcube 
can divided into D + 1 layers where the occupation probability of a state 
in the k-ih layer with Hamming distance k to the starting configuration at 
time t is denoted by p k (t). 

The number of states in the fc-th layer can be calculated as 

If c k and c k are the numbers of nearest neighbours for a state of the fc-th 
layer in the {k + l)-th layer and the {k — l)-th one, respectively, it follows 
that 

4 + c- k =d. (10) 

The number of all connections between layer k and k + 1 must be the 
same as between layer k + 1 and k and therefore 

/ i \ k + 1 

n k c\ = n k+1 c k+1 = n k+1 [d - c+ +1 J => c+ +1 = d- jj—j^4 ( U ) 



and 



A - A D ~ l + A D ~ k ~ A d ^ 

1 = J) ^■■■^ c t = d ~ 5" c k = d p ■ ( 12 ) 
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Now the occupation probability of a state in the fc-th layer at time t+1 can 
be written as 



Eq. (13) is equivalent to a matrix multiplication p(t+ 1) = Bp(i) where 
the matrix B is given by 



The long-time behaviour of the unstructured system is given by the 
largest nontrivial eigenvalue of B. For a given set of N, D and d this can 
easily be done using numerical standard methods. 

The values of N and d are defined by the number of spins and the mean 
number of nearest neighbours in the configuration space of our representative 
system (N = 64, d ~ 7.7). D has to be chosen in such a way that the total 
number of states is correct (i.e. ~ 10 5 in our case). The total number of 
states in the unstructured system is 



Using this combination of N, D and d the eigenvalue can be calculated 
as Ai = 0.987 and InAi = —1.4 • 1CT 2 . The time belonging to this values is 
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Figures 



1. Energy and degeneration of ground states for 200 random sys- 
tems. 

2. Detailed structure of the configuration space up to and including 
the second excitation for the representative system. The drawn 
circles denote microcanoncial clusters. For each excitation the size 
of a circle is proportional to the number of states in the cluster, 
where the scaling factor differs for different excitations. 

a) Explanation by a schematic picture of a hierarchical structure 

b) Result of an exact detailed analysis (the full lines mark an 
example of a closed circle path). 

3. quit) for random walks in the representative system with different 
starting configurations k for (5 — 0. 
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